Entangled networks, synchronization and optimal network topology 
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A new family of graphs, entangled networks, with optimal properties in many respects, is intro- 
duced. By definition, their topology is such that optimizes synchronizability for many dynamical 
processes. These networks are shown to have an extremely homogeneous structure: degree, node- 
distance, betweenness, and loop distributions are all very narrow. Also, they are characterized by a 
very interwoven (entangled) structure with short average distances, large loops, and no well-defined 
community-structure. This family of nets exhibits an excellent performance with respect to other 
flow properties such as robustness against errors and attacks, minimal first-passage time of random 
walks, efficient communication, etc. These remarkable features convert entangled networks in a 
useful concept, optimal or almost-optimal in many senses, and with plenty of potential applications 
computer science or neuroscience. 

PACS numbers: 89.75.Hc,05.45.Xt,87.18.Sn 
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The ubiquitous presence of networks in Nature and so- 
cial sciences is one of the main findings in the study of 
complex systems. The topology of such networks has 
been profusely studied Q and some basic architectures 
have been discovered. The scale-free one, characterized 
by a power-law connectivity-distribution, is probably the 
most widely studied and celebrated, while other exam- 
ples are small-world, hierarchical, Apollonian, static net- 
works, etc yj. Right after the first topological studies, 
the interest has shifted to the analysis of functional or 
dynamical aspects of processes occurring on networks, 
the evolution of the network topology, and the interplay 
between these last two dynamical features. Indeed, this 
"network perspective" has become a new paradigmatic 
way to look at complex systems. One particular issue 
that has attracted much interest because of its concep- 
tual relevance and practical implications is the study of 
the synchronizability of individual dynamical processes 
occurring at the vertices of a given network. How does 
synchronizability depend upon network topology? This 
problem is much more general than it seems at first sight, 
as it is directly related to the question of how difficult it 
is to transmit information across the net or how difficult 
is for the sites to "talk" to each other. For example, a re- 
cently addressed important task is to determine the most 
efficient topology for communication networks both with 
and without traffic congestion |2(. Other problems as 
the minimization of first-passage times of random walk- 
ers on networks, the optimal topology in social networks 
to reach consensus, or the performance optimization of 
Hopfield neural-networks 0,3 are also similar in essence. 
Hence, the issue of synchronizability is linked to many 
specific problems in different disciplines as computer sci- 
ence, biology, sociology, etc. 0,0. Some aspects of these 
problems have been already tackled; a key contribution 
is due to Barahona and Pecora (BP) |5| who established 



a criterion based on spectral techniques to determine the 
stability of synchronized states on networks. 

The criterion is as follows. Consider a dynamical 
process ii = F(xi) — o~J2j LijH(xj), where Xi with 
i € 1, 2, N are dynamical variables, F and H are evolu- 
tion and coupling functions respectively, a is a constant, 
and Lij is the Laplacian matrix, defined by La = ki (the 
connectivity degree of node i), — — I if nodes i and 
j are connected, and = otherwise. A standard lin- 
ear stability analysis can be performed by i) expanding 
around a synchronized state x± = x% = . .. = xjy = x s 
with x s solution of x s = F(x s ), ii) diagonalizing L to 
find its N eigenvalues = Ai<A2<...<Aat, and 
iii) writing equations for the normal modes yi of per- 
turbations yi — [F'(x s ) — a\iH'(x s )]yi which have all 
the same form but different effective coupling a = <tA;. 
BP observed that the maximum Lyapunov exponent is in 
general negative only within a bounded interval [a a, olb], 
and a decreasing (increasing) function below (above) (see 
fig. I in Q). Requiring all effective couplings to lie within 
such an interval, a a < crA 2 < ... < aX^ < «b, it is 
straightforward to conclude that a synchronized state is 
linearly stable on a network if and only if ^ < sa. No- 
tice that the left hand side depends only on the network 
topology while the right hand side depends exclusively 
on the dynamics (through F and G, and x s ). Moreover, 
the interval in which the synchronized state is stable is 
larger for smaller eigenratios Xn/X2, whence one con- 
cludes that a network exhibits better synchronizability if 
the ratio Q = Xn/X2 is as small as possible, indepen- 
dently of the dynamics. 

This letter is devoted (i) to build-up networks with a 
fixed number of nodes N and average connectivity (k), 
exhibiting a degree of synchronizability as high as pos- 
sible (i.e. minimizing Q), (ii) to explore the topological 
features converting them into highly synchronizable, and 
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(iii) to highlight their connection to networks optimizing 
other flow or connectivity properties relevant in neuro- 
computing, computer science, or graph theory. 

First, we overview how Q behaves in some well-known 
topologies. For networks with the small- world property 
Q is smaller than for deterministic graphs or purely 
random networks 0. This was attributed to the exis- 
tence of short characteristic paths between sites. How- 
ever, Nishikawa et al. in a study of other small- world net- 
works concluded that Q decreases as some heterogeneity 
measures decrease, even if the average distance increases 
0. Also, Hong et al. concluded that Q decreases when- 
ever the betweenness heterogeneity decreases Q. In or- 
der to extend and systematize these results and construct 
optimal synchronizable networks, and in the absence of a 
better strategy, we define a numerical algorithm able to 
minimize Q and search for such optimal nets. 

Our optimization algorithm is a modified simulated 
annealing initialized with a random network with N 
nodes and an average connectivity-degree (k). At each 
step the number of rewiring trials is randomly ex- 
tracted from an exponential distribution. Attempted 
rewirings are (i) rejected if the updated network is dis- 
connected, and otherwise (ii) accepted if SQ = Q final — 
Qinitiai < 0, or (iii) accepted with probability || 
p = min(l, [1 - (1 - q)5Q/T] 1 ^ 1 -^) (where T \s a 
temperature-like parameter) if SQ > 0. In the q — ► 1 
limit the usual Metropolis algorithm is recovered, while 
we choose q = —3 as it gives the fastest convergence 
(though results do not depend on this, as already ver- 
ified in H). The first N rewirings are performed at 
T = oo, and they are used to calculate a new T such 
that the largest SQ among the first N ones would be 
accepted with large probability; in particular, we take 
T = (1 - q) ■ (SQ) max . T is kept fixed for 10(W 
rewiring trials or 10./V accepted ones, whichever occurs 
first. Then, T is decreased by 10% and the process iter- 
ated until there is no change during 5 successive temper- 
ature steps, assuming that a (relative) minimum of Q has 
been found. Most of these details can be changed with- 
out affecting significatively the final results, while the 
main drawback of the algorithm is that the calculation 
of eigenvalues is slow. 

The network found by different runs of the algorithm 
is unique (in most of the cases) as long as N is small 
enough (N < 30) , while they are slightly different if N is 
larger (N — 2000 is the larger size we optimized). This 
indicates that the eigenvalue-ratio absolute minimum is 
not always found, and that the evolving network can re- 
main trapped in some "metastable" state. Nevertheless, 
the final values of Q are very similar from run to run as 
shown in fig. ^ This fact makes us confident that a rea- 
sonably good and robust approximation to the optimal 
topology is obtained in general, though, strictly speaking, 
we cannot guarantee that the optimal solution has been 
actually found. To gain some insight into the topologi- 




FIG. 1: Eigenvalue ratio, Q as a function of the number of 
algorithmic iterations. Starting from different initial condi- 
tions, with TV = 50, and (k) = 4, the algorithm converges to 
networks, as the depicted one, with very similar values of Q. 
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FIG. 2: Relation between the ratio Q and (i) node- 
connectivity standard deviation, (ii) betweenness standard 
deviation, (iii) average node-distance, and (iv) average be- 
tweenness. The subscript "norm" stands for normalization 
with respect to the respective mean-values, centering all the 
measured quantities around 1. 

cal traits favoring a small Q, we measure some quantities 
during the evolution and plot them versus the changing 
eigenratio. It turns out (as shown in fig. 01 that there is a 
strong correlation between the tendency of Q to decrease 
and an increase in the homogeneity (lowering variances) 
of the degree, average-distance and betweenness distribu- 
tions. In a nutshell, the more synchronizable the network 
the more homogeneous it is. Also, the average distance 
and betweenness tend to diminish with Q, though these 
quantities arc much less sensitive that their correspond- 
ing standard deviations (fig. [2J. The emerging narrow 
betweenness distribution is in sharp contrast with that of 
networks with a strong community structure [t| . Indeed, 
a well known method to detect communities consists in 
removing progressively links with the largest between- 
ness . The method leads to sound results whenever the 
betweenness is broadly distributed. Hence, well-defined 
communities do not exist in the emerging optimal net. 

Further inspection of these networks reveals another 
significant trait: the absence of short loops. This can 
be quantified by the girth (length of the shortest loop) or 
more accurately by the average length, (£) , of the shortest 
loop passing through each node. In general, the cluster- 
ing coefficient vanishes, as loops are larger than triangles. 
Indeed, for small values of N and k, it is possible to iden- 
tify the resulting optimized networks, as they have been 
studied in the mathematical literature: some of them 
are cage graphs. Let us recall that a (fc,<?)-cage graph 
is a fc-regular graph (i.e. with a delta-peaked connectiv- 
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ity distribution) of girth g having the minimum possi- 
ble number of nodes. For k = 3 and N = 10, 14, and 
24, respectively, the optimal nets found by the algorithm 
are cage-graphs with girth 5, 6, and 7 (called Petersen, 
Heawood and McGee graphs) respectively (see fig. 3 and 
[Io|). For other values of N cage graphs do not exist but, 
in all cases, networks with very narrow shortest-loop dis- 
tributions, with large mean values, are the optimal ones. 

In general, we call the emerging structures entan- 
gled networks: all sites are very much alike (super- 
homogeneity) and the links form a very intricate or in- 
terwoven structure (no community-structure, poor mod- 
ularity, and large shortest-loops). Every single site is 
close to any other one (short average distance) owing not 
to the existence of intermediate highly connected hubs, as 
in scale- free nets Q , but as the result of a very "demo- 
cratic" or entangled structure in which properties such 
as site-to-site distance, betweenness, and minimum-loop- 
size are very homogeneously distributed (see figs. 1, 3). 

We have tried to use our (so far, partial) understand- 
ing of the entangled-topology to generate them more ef- 
ficiently. For example, the constraint of homogeneity 
in the degree distribution can easily be implemented by 
starting up the simulation with regular graphs (or almost 
regular graphs) and performing changes respecting such 
a property (by randomly selecting pairs of links and ex- 
changing their endpoints). A much faster convergence 
to optimal nets is obtained in this way. Other topo- 
logical constraints are not so easy to implement. We 
have performed simulations using target functions differ- 
ent from Q in the optimization algorithm. Functions as 
the average distance, average betweenness, or homogene- 
ity measures (such as the distance variance or the be- 
tweenness variance), or (£) are not sufficient: they need 
to be optimized simultaneously, in some proper way, to 
obtain reasonable outputs. We have tried different com- 
binations of these quantities. The best convergence and 
results are obtained for the following combination of the 
betweenness, b, the betweenness variance, Ab and (£): 
U = (( Ab )^-W 2 ) - (i). The optimization of U is much 
faster than the minimization of the eigenratio as U is 
faster to compute than Q. For small networks the final 
result is as good as the one of the original method but, 
unfortunately, when N increases results worsen, though 
the computational time is always relatively small. This 
failure means that a full topological understanding of 
(large) entangled networks has not been reached yet. 

In order to put our findings into context, we discuss 
some connections with known concepts in graph-theory. 
General considerations show that An € [k, 2k] for reg- 
ular graphs 0, 0| . As the variability of Ajy is very 
limited, optimizing Q is almost equivalent in most cases 
to maximizing A2 (also called spectral gap), as we have 
verified numerically. It is also known that for any family 
of regular graphs, G m (m is the family index), in which 



the size N goes to infinity for large m the inequality 
A2 < k — 2vfc — 1 holds asymptotically, providing an up- 
per bound for the spectral gap. Finally, it can be shown 
that for any family G m in which the girth goes to infin- 
ity for large m, almost all eigenvalues are asymptotically 
larger or equal to k ~ 2yfc — 1, meaning that the opti- 
mal gap value is typically obtained whenever the girth 
diverges for large N 0, 0|. These results are in ac- 
cordance with our observation of large girths and large 
(£) for entangled networks (even if they are not at the 
large- N limit). Another link with graph theory is pro- 
vided by the concept of expanders. These are highly con- 
nected sparse graphs, with applications which include the 
design of super-efficient communication networks and de- 
randomization of random algorithms among many others 
[I2I , and are defined as follows 0, . Given a sub- 
set S of nodes in a graph G, its "edge boundary" is the 
set of links between nodes in S and nodes in its comple- 
ment. The "expansion parameter" h of a graph G is the 
minimum ratio of the edge-boundary of a set and the set 
itself. A sequence of regular graphs G m is a family of ex- 
panders if its size N diverges for large m and h is always 
larger than a given positive constant. This means that 
the boundary of any subset is always a non-vanishing 
fraction of the subset itself. Note that a large value of 
h corresponds to a very intricate (entangled) network, 
where it is not possible to isolate subsets with a small 
boundary (or, in other words, where communities are 
poorly defined). Also, the expansion property is strictly 
related to the spectral gap 12]: 4^ < h(G) < y/2k\~2, 
meaning that (families of) entangled networks are ex- 
panders. Ramanujan graphs [12J are defined as /c-regular 
graphs of size N with A2 > k — 2^/k — 1. Hence, these 
graphs are optimal expanders [T3 | . A family of entan- 
gled networks, will typically be a Ramanujan one (as A2 
tends to be maximized) and, therefore, a (close to opti- 
mal) family of expanders. The explicit construction of 
expanders and Ramanujan graphs is a currently active 
field in graph-theory [lj, [Rj, and it could serve as a 
starting point for explicit entangled-network design. 

Some properties of entangled networks as related to 
other optimization or flow problems follow: 

i) In a recent paper (l4| , the optimization of network 
robustness against random and/or intentional removal of 
nodes has been studied. It was concluded that for gen- 
eralized random graphs in the limit TV — > 00 the most 
robust topology (maximizing the percolation threshold) 
is characterized by a degree distribution with no more 
than 3 distinct node connectivities; i.e. with a rather 
homogeneous degree-distribution. To study the possible 
connection with our super-homogeneous entangled net- 
works, let us recall that the initial topology we have 
considered (i.e. /c-regular graphs) is already the opti- 
mal solution for robustness-optimization against errors 
and attacks in random networks flij . A natural question 
to ask is whether further Q-optimization has some effect 
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FIG. 3: Cage graphs for k — 3 and (a) g = 5 (Petersen) 
and (b) g = 7 (McGee). Right panel: Percolation threshold 
(main) and average first-passage time (inset) as a function 
of the eigenratio Q, as obtained during the optimization of 
a network with 500 nodes and (k) — 3. The initial network 
corresponds to a 3-regular graph with N = 500. 

on the network robustness. The answer is yes, as shown 
in fig. |3 where the percolation threshold for random or 
intentional attacks (which coincide for regular graphs), 
f c , is plotted versus Q for a particular Q-optimization 
run. This further improvement of the robustness is pos- 
sible because entangled networks include correlations, ab- 
sent in random graphs (l^j . This tendency is maintained 
for increasing N, confirming that entangled networks are 
also extremely efficient from the robustness point of view 
(this remains true for reliability against link removal [lflj ) . 

ii) The problem of optimal topologies for local search 
with congestion has been tackled recently Q{, with the 
conclusion that when the density of information-packets 
traveling through a network is above a given threshold, 
the optimal topology is a highly homogeneous one, where 
all the nodes have essentially the same degree, between- 
ness, etc Q- Again, we encounter super-homogeneity, 
revealing that entangled networks are also optimal for 
packet flow and local searches with congestion. 

iii) A typical measure of the network performance for 
flow properties is the average first-passage time, r, of 
random walks. It is defined as the average time it takes 
for a random walker to arrive for the first time to a given 
node from another one. For a fc-regular graph, r can be 
expressed in terms of the Laplacian eigenvalues as t a 
Y"l A " 1 , where the sum runs over all non-zero eigenvalues 
[l6| . The largest contribution comes from 1 / A2 , therefore 
minimizing Q guarantees a small r (see inset in fig. [3J, 
providing more evidence that entangled nets exhibit a 
very good performance for flow problems. 

iv) Recently Kim concluded that neural networks with 
lower clustering coefficient exhibit much better perfor- 
mance than others Entangled nets have a very low 
clustering coefficient as only large loops exist and, there- 
fore, they are natural and excellent candidates to have a 
good performance and large capacity. 

All these features suggest that entangled networks, de- 
fined here as networks which optimize synchronizability, 
are also extremely good with respect to many highly de- 



sirable properties in networks. This allows us to state 
the following conjecture: Given N and an average num- 
ber of links per site k, there exists a network topology 
(entangled nets) with many optimal (or almost optimal) 
features, characterized by homogeneous degree, between- 
ness, and distance distributions, large girths, large aver- 
age shortest loops, no community-structure, and small 
diameters. A more precise topological characterization 
of entangled graphs, as well as the definition of an al- 
gorithmic procedure to build them up (similar to those 
existing for expanders and Ramanujan graphs), remain 
open and challenging problems with a huge amount of po- 
tential applications for communication and technological 
networks. It seems that these networks do not abound 
in the real world; this could be due to the fact that op- 
timal topologies are not easily reachable within growing 
network processes. Identifying examples of these nets 
and constructing evolution-reachable optimal networks 
are fundamental tasks to further gauge the relevance of 
this topology in Nature. 
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